Papers with multilingual model decoder representations
Exploring Geometric Representational Disparities between Multilingual and Bilingual Translation Models (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing work shows that limited modeling capacity is a major contributor to reduced performance in multilingual models. |
| Approach: | They investigate the isotropy of multilingual model decoder representations using intrinsic dimensionality and IsoScore to measure how they utilize the dimensions in their underlying vector space. |
| Outcome: | The proposed model decoder representations are less isotropic and occupy fewer dimensions than bilingual models. |